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(57) Abstract 

Method and system for audio synthesis of a digital data file representing an assembly of information-bearing f^^^J^^^j^) in dig^^^^ 
form. One or more spaced apart data segments are designated as key blocks (19) and are removed from the ongmal data file ^^^^ ^^^^^^ 
(21) of the data file is encrypted or otherwise encoded and communicated to a selected recipient on a first channel (53). Locations, s zes 
and separation distances of key blocks from each other within the original data file and a selected P^^*°" <^^/^*;f^"^^^^^^ 
kev are placed in a data supplement. The removed segments and data supplement (optional) are communicated to the selected recipient on 
a second channel (55) and/or at another time. The original data file is recovered by using the data supplement information, or "^ing al^^^^ 
available infomiation. decoding or decr/pting the encoded or encrypted data file and replacmg the .^^^^^^^^f."^^^^^^^^ 
remainder. Neither the remainder data file nor the removed segments plus data supplement is sufficient, by itself to ?1^^^^,^P^^^^^^^^^^ 
the original data file. Each of the remainder data file and the removed segments plus data supplement can be distributed separately ana 
subsequently combined when authorization or license to reproduce the sounds has been obtained. 
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AUDIO SYNTHESIS USING DIGITAL 
SAMPLING OF CODED WAVEFORMS 



Field of the- Invention 

This invention relates to coding and reproduction of audio signals. 
Background of the Invention 

Digital synthesizers or other electronic systems that create music or 
other soimd can often be utilized as an electronic musical instrument or 
electronic sound machine. A digital synthesizer is often arranged to accept 
signals from a musician or operator interface and to produce digital output 
signals that represent analog signals in the audio frequency range. A digital 
synthesizer is also frequently arranged to accept pre-recorded sequences of 
music events in a Musical histrument Digital hiterface (MIDI) format. 

A digital output signal from a digital synthesizer can be converted to 
an analog signal and dehvered to equipment, such as a loudspeaker, tape 
recorder, mixer or other similar device, to reproduce the signals as 
. intelligible sound. The digital synthesizer can be arranged to provide output 
signals that simulate the sounds of one or more conventional musical 
instruments/Altematively, the synthesizer can be arranged to simulate 
sounds thai would be emittisd by a theoretical in&trpmeiit having : , 

predetermined audio charaeteris^cs that are partly or wholly different from 
the cqrre^onding characteristics of any convention, known instrument .'; .; 

, For-:previous syiithesizers,. synthesis of music an4' other sounds is a ' . 
fonnidable task. A real musical instrument produces a complex blend of . 
many different frequencies and impart what is commonly referred to as , . 
"tone color" or "timbre", to the associated sound. For example, a percussion 
sound made by a drum or cymbal is an aperiodic sound that cannot be fully 
described by any simple mathematical functioii. Accordingly, the 
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reproduction or synthesis of digital signals representing sounds as rich and 
complex as a real musical instrument is a formidable task for digital signal 
sampling and processing. Ideally^ the synthesizer should respond to the 
nuances of a musician*s manipulation of the. interface (e.g., a particular 
musical instrument). For example^;a:snare drum has many different audio 
characteristics when played in different locations,- such. as adjacent to the 
center of the drum membrane, adjacent to the: rim, or on the rim of the 
drum. Additionally; the audio characteristics of a percussion instrument will 
vary with the striking force and stylistic inflection of the musician. 

By providing a large enough, waveform database, more realistic and 
expressive synthesis of a given group of sounds can be achieved. Many 
synthesizers relying on waveform sampliiig technology are used extensively 
in the music and multimedia fields :for their ability to create musical sounds 
that closely emulate the sound of a musical instrument. . 

At present, a digital synthesizer system often utilizes aMIDI to 
control the synthesizer. The MIDI interface jcreates control signals or other 
MIDI control data. The MIDI control data may represent a music event, 
such as occurrence of specific musical notes .from a^particular musical 
instrument, such as a piano, drum or horn. However, IVI has some 
fimdamental limitations. For. example^ a syijthesizer that uses a MIDI 
notMoh has%ouble¥ecrea^^^ human' voice, y - . ^ ^ . . ^ 

• • A coflvehtiofial synthesizer; system utilizes; a large solid state memory 
that stores the" digital waveform: signals representing.each note played on a 
particular instrument. The mraioiy) ca^ static randprn access memory 
(SRAM), a dynamic random^ access memory, (DRAM), a read only memory 
^ (ROM) or some other similar mempry vdth sufficiently rapid 
Whein a musician actuatesa key .or other interface device, the appropriate 
waveform is selected, depending upon the key actuated and upon the 
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intensity and vblocity of the key strike. The waveform is then converted into 
an analog output-signal for soiind reproduction. A digital waveform, signal 
can be combined with other waveform signals that represent other musical 
notes being displayed, before the conversion to an analog output signak 
- ^ In this arrangement, the synthesizef.in effect, merely plays back 
digital recordings ofihdividu^ musical notes or other sounds. Each. 
waveform signal is stored as^a collection of individual data words, each 
representing a single sample of the waveform, at a particular time. _ 

A-^equehcer is a device for editing musical data, such as MIDI , 
0 events, and converting the musical data into a musical signal in real time. 
Synthesizers are frequently used together with.a computer ta.play..a.musical 
score. In this arrangement, a sequencer reads a.MIDI file;as an ordered . . 
sequence. However, it is generally recognized that mDl files and . . -.^ 
synthesizers are uiiable to- recreate the nuahces in a recording or to capture 
15 the backgroundndises ofalive audience. . •; . . : . r _ - 
• Other prior art systems store, only: orteora relatively few. wavefor^ 

signals representing each musical instrumerit. Iliese .stored waveforms ge 
then adjusted by digital signal processing or other electronic techniques, 
such as nonlinear- distortion, to. reflect the. frequency and amplitude changes 
20 assodated with particu^ musical. Characteristics,^ as indicated.by the MIDI, 
control data. For example,-the frequeacyQahd amplitude of.a sample, , 
waveforih fepfesmting middle e^on^apianb^^ l^e-.adju^tgd.to synthesize a 
^ different piaiio rime:aMd.volume.lHo.wever, these synthesizers are unable to 
. (re)pfmte the cdihple^ or-.tonecolor with high- enough fidelity for 

25 therriusically-frainedear. .. • V J-.- . = -: 
: - . Inahotherappfoach, some systems.use digital filtering to adjust the 
hafmonic content of ^particular note. However, these systems require a 
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large amount of computer power and can be, affected by audio quality 
degradation. ' . . 

What is needed is an audio synthesizer system that can reliably 
reproduce all types of sounds, including music and the human voice. 
Preferably, the system should, allow a separation of niusic or other 
information-bearing sound into two or more selected components, where no 
single compbhent allows reproduction of. sounds resembling the original 
sounds. Preferably, the system should dlow encryption or other encoding of 
one or more of the selected components and should allow change of 
parameters affecting the format of one or . more of the components. 

Summary of the Invention 

These needs are met by the -invention, which provides a systepi for 
removing one or moire selected segments (referred to collectively as pre- 
processing components, or PPCs) of a digital signal stream that represents 
an assembly of information-bearing sounds (ISA), including but not limited 
to music and one or more human voices, to produce a remainder data file 
(referred to as a reduced data file, or ISDF), having one or more 
components, after decimation Of the ISA by removal of the PPC(s); The 
ISDF, as a first sequence, and the assembly of PPCs, as a second sequence 
are preferably processed differetttly and coromum 

communication channels. The ISDE is preferably /encrypted or otherwise 
encoded, using an encryption^^ that may be chosen independently or 

inay depend upon information contained, in the PPG(s). A data supplement 
' DS , associated with the PPC(s) sequence^ contains one or more of the 
following information items:, location of at least one PPG within the original 
ISA; size of one or more of the PPCs; size of one or more components of 
the ISDF; sepai-ation distance Within the ISA of two consecutive PPCs (if 
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two or more are removed); and at least a . portion of the encryption key EK. 
The encrypted version of the ISDF, E(ISDF), is communicated over a first 
communication channel, and the PPC(s) and the associated data supplement 
DS are corriihimicated over a secondxommimication chaimel, which may be 
5 arranged as a secure communication channel. Optionally, the PPC(s) and 
associated data supplement chaimel may also be encrypted for . . 
corhmunication. Optionally, more than, one sequence of removed .PP^s can 
be formed, each with .an associated data supplement DS, and communicated 
separately from the remalining ISDF component(s). . :• . . 
10 The invention allows an assembly of informatiori-bearing sounds 

ISA, such as music or the sound(s) of one or more human voices, to be 
disassembled into N+1 complementary sequences (N-1), where any 
collection of N+l-k sequences (1 ^.k n N), including the ISDF, will not 
allow reconstruction of an assembly of sounds resembling the original ISA. 
15 ; One useful application of this inveiition is the provision of a legally - 

protected ISA (e.g., an ISA covered by copyright) as Nf 1 sequences , ^, 
where any collection of N or fewer sequences cannot be.used to reproduc£ 
the ofiginal ISA. The invention would, for .example, allow distribution of a 
subset N+ 1 -k of these .N+ 1 sequences to a prospective authorized listener at 
20 one time (e.g., ^for stbrage for possible future use),and distribution of the . 
reinaining k. sequences (1 .|j:k ^ N) at'anbt^^^^ 
authorized'to listen to. the.entire IS A^ : o i > \,. . : : sr. . :; 

■Another usefiil applicatioii bf the invention is the provision or earher 
distribution of a first sequeiice, representing the bulk or inajority of the 
25 sounds needed to accurately reproduce the ISA, where the first sequence.has 
certain critical data removed. The second sequence, containing the 
remainder of the ISA data:.ne.eded .to accurately reproduce the ISA, is 
distributed using another channel and/or at another, more convenient time. 
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Brief Description of the Drawings . . \ 

Figure 1 is a schematic view of apparatus that creates an MP3 file. 
Figures 2A-2C illustrate an oiiginal ISA, expressed as a digital 
sequence, and the results of disassembly of the IS A into an ISDF and a 
sequence of -PPCs and of association of a DS with a PPC sequence. 

- Figure 3 is a schematic yiew;of a digital file sampling, composer and a 
digital file sampling synthesizer. / ■ ;. - , 

Figures 4, 5 and 6 are flow charts illustrating practice, of . 
embodiments of the invention. ; .. : -. . 
Description "of Best Modes of the Invention , . 

MP3, which refers to Layer 3 of the MPEG 1 standard, has been 
developed and adopted as a useful audio, compressipn standard for music 
and other assemblies of information-bearing sounds.(ISAs). MP3 is 
discussed iii some detail in ISO/IEC 1 1 172-3, an intemational standards 
document, incorpbrated by reference .herein. A protocol for creation of an 
MP3 file is wisU knowii to those of or(ynary skill in the are of sound 
compression. Many software programs, such as Audio Catalyst, offered by 
Xing Technology,' w'hich rims on a personal computer, implement creation 
an MP3 file. V : - „ : 

" Figiire 1 illustrates, apparatus l l . that may rbe:used to cr^^^ ,. 
file 1 3 fi-om an' ISA 1 5 . The ISA ,1 5 is ireceiyed by a digital fije sampling 
composer (DFSC) 17. The DFSC 17 creates and issues, a, synthesizer 
informktion file' (SIF) 19 and ;an item:specific data file (ISPF) 21. For 
decoding, a DFS synthesizer 23 reeeivesjand. uses the SIF 19 to pro-^dde 
suitable sequencing for the ISDF 2;1.; The recovered MP3 fil,e 1,3 is received 
and decoded by an MP3 decoder^:25j which issues a pulse. code modulation 
(PCM) waveform 27. The PCM waveform 27 can be played or otherwise 
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"displayed" through a digital-to-analog converter"(DAC) 29, eoiinected.to a 
speaker 31. ' 

Figures 2A-2C illustrate an ISA 15 as an ordered sequence of bits, 
nibbles, bytes or other information units, numbered n = 1, 2, .... , 27, that are 
5 part of an ISA. The ISA (e.g., an MP3 source file) 15. .can be any length. A 

. y, . .. - - . - . 1 n')ti "C" "A" "7" "19" "17" 

firstsubsetof these information umtsy namely 2 , 5 Q , v , » 
"18", "26", "27", is removed as a sequence-of pre-processing.pomppnents 
(PPCs) and is stored in^ an SIF- 1 9.-The remaining data are stored in an ISDF 
for encryption. In Figure 2 A, the ISA 15 is shown with a 32-bit header (or 
10 trailer, if desired), 27 bytes of data arid aii ID3_tag. The ISDF 21,, shown in 
Figure 2B, has a file identification (FID) tag and a data field with a selected 
number of bytes of samples. The SIF 18, shown in Figure 2C, has an F.ID^ 
field, an ID3 tag, a 32-bit header field, a 2 byte file block.(FB) fipld, a 2 . , 
byte soiig block (SB) field, a variable blocik size.(BS) field, a:l-bit end^of. 
15 selection (EOS) flag and at least a portion of an encoding/encryption key^ . , 
(EK). The field block FB specifies the number of blocks of data for the ^ 
ISDF 21 . the song block SB specifies the number of blocks of data to be 
' removed for the SIF 21, preferably using a file stripping algorithm. The 
block size filed BS specifies the number of bits per block, which may be 
20 ' uniform or ma>^ be ridn-uniform. The EOS flag, indicates that.the coding , 
process^ended-oh^datafdr^fe-Sn^ 1^ or.ended-ondata forthe 

ISDF-21 (EOS=K)). " ' ' ■ ■ ' • ^ - ' = - ■•■-'^ ■ • • 

■ '■ Figure 3 illustrates a DFSC 17' which includes a first,.CPy 41 , .a. first 
RAM 43, a first ROM 45, a first User interface 47, a removable storage unit 
25 49, a '(^ta I/O module 51-, and first(fflid second communication channels, 53 
and 55. The first interface 47.mayiiiciude any or all of a keypad, keyboard, 
Ught pen or other data/comiriand entry device, a mouse, and a display 
module, such as a monitor, LED or LCD device. The first and second 
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channels, 53 and 55, may be. the same channel. Alternatively,; the first and 
second channels may be different: For example, the second channel 55 may 
be a secure channel that offers at least: a reasonable degree of protection 
against unauthorized reception of the signals on the second channel. 

Figure 3 also illustrates a DFSS 23,:which includes a second CPU 61, 
a second RAM 63, a second ROM 65, a second user interface 67, a data I/O 
niddule 69, a data synthesizer database 71, a removable storage device 73, 
and a DAC 75; The data synthesizer database 7 1 may include an ISDF 
database 71 A and/or an SIF database 7 IB. Thexemovable storage device 73 
may include an ISDF database 73 A and/or an SIF database 73B. 

Digital samples that are part of the ISDF 21 and/or are part of the SIF 
19 may be triansferred from the DFS. composes 17 to the DFS synthesizer 23 
using the first communicatioii channel 53 )for ISDF sample's) and/or the 
secbnd comihunication channel 55 (for SIF samples) and/or may be 
recorded using the removable storage device 73 and subsequently^ 
transferred to the DFS synthesizer 23. 

In a preferred embodiment, at least one of the first and second ; 
communication channels, 53 and' 5 5, is the Internet. However, any other 
conmiimication channel(s) can be used to communicate ISDF samples 
-and/or SIF samples, including wireless methods;:such as FM subcarrier, . 
GDPD, transmission using the vettical blanking inlet^al of a.teleyi 
signal, and'other similar wireless methods: \ : :\ . : i ; . ; ; - 

The ISDF- database 71 A arid- the SIF database^71B:may include 
samples from any of several sample soiirces/. r - : ^ ; ; v ; ; : : 
' ' The DFS synthesizei^ 23 can operate in many different modes, 
including the following: (!)" synthesize, an MP3 file from. an ISDF database 
^ 71 A and frorn SIF samples stf earned 'from the second conimuni cation 
channeI55; (2) synthesize an MP3 file from ISDF samples streamed from 
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the first eoiimiunicition channel 53 and from an SIF database 71B; (3). , 
synthesize an-MP3 file from an ISDF database..73A and from:S.IF samples 
streamed from the second communication channel 55;. and (4) synthesize an 
MP3 file from an ISDF database .VIA and from. an SIF database 73B. 
5 Figure -4 is a flow chart illustratihg a procedure for practicing audio 

synthesis according to the invention. Iti step 8 1 , an ISA including-ari 
ordered sequence of units containing digital symbols, is provided. In step 
83; the PPCs within the ISA: are designated and stripped put or remoyed 
from the reihainder ISDF of the ISA; .In step 85, a. file identification rumber 
10 FID is assigned to the PPCs and to the ISDF. In step-:87,:One or more , / 
parameters that characterizes the PPCs and/or the ISDF components is 
provided and is placed in a data supplement DS that is associated wit^ the 

PPCs (preferable), to provide an augmentedPPC sequence, PPC+DS.^. 
and/or with the ISDF. In step . 89, aii . encoding key iEK .(e.g.,ran encryption 
15 key) is provided, either independently or using one or more.paramet||S 
provided by one or more components of :the PP.Cs. ^Normally, the EK.will 
have a fixed encoding procedure but.optionally will have one or more 
parameters that are adjustable according fo. information supplied by the 
PPCs or the ISDF. For example, one pr more PPCs may provide initial 
20 values needed to begin the encoding process. In- step 91, the ISDF (or an , - 
augmeritationiISDF;+pS) is iencoded- d^, encryptgd), using the encoding 
key EK, to produce an encoded y.ersiofi E(ISDF>: In step. 93. .(optional; 
usually not rrecessary),.the augiiiented.PPC.sequence;PP.C+pS, is also 
encoded to provide an encoded; version E(PPC+DS). . ... 
25 • . In step '95:, the encoded version E(ISDF) is communicated using a . 
first communication channel, and theraugmented PPG sequence, PPC+DS, 
is communicated using-a second communication channel. The first and 
second communication channels may:be the same„if desired. Altematively, 
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the second communication channel may be a secure channel, to- protect an 
non-encoded augmented PPG sequence, PPC+DS,- from disclosure to 
unauthorized entities. ; • ■ . 

In step 97, the; encoded version E(ISDF) and the augmented PPC 
sequence, PPG+DS (or E(PPC+DS.)), are received or otherwise provided, 
aiiid a decodmg (e.g., decryption) process is begun. In step 99, the data 
supplement DS within the augmented PRC. sequence, PPC^^ 
examined, the PPC and/or ISDF pcffameters are. identified, and (optionally) 
part or all of the encodingkey EK is recovered. In step 1 0 1 ^ the-encoded 
version E(ISDF) is decoded, to (re)produce the ISDF. In step 103, the PPC 
components are repositioned among the ISDF components to recover the 
original ISA. In step 105 (optional), the ISA is provided for an ISA 
repository for playback, display, storage or further processing. 

■ Optionally, the steps 97-1 03 may be varied by providing a first .of the 
two sequences, E(ISDF) or PPC+DS^ in a first database that is available at 
one or more locations to any potential user. However, possession of the first 
sequence, or of the second sequence, along, does not allow the user to 
reproduce the sounds of the' original ISA. Each of the first sequence and the 
second sequence is a decirriated version of the original ISA; and the sounds, 
" if any, reproduced'by 'the first sequence or by the second sequence alone 
are, preferably, not intelUgible. The second sequence is withheld until the 
user has obtained proper atithorization (e.g.,. a license) ; to reproduce the 
sounds Of the origirial lSA; The- first sequence may, if detsired, . represent the 
majority or Sulk of the digital«sigrials;neededi tb.reproduGe the original ISA 
so that the remainder (second sequmce) requires far less . bandw or 
communication capacity for delivery than does: tiie. original ISA. 

' The encoding procedure may, for example, incorporate an. encryption 
process, such as cipher block chaining (eBC),,described by. Bruce- Schneier, 
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Applied r.rv ptographv. John Wiley & Sons, Second Edition, 1996, pp. 193- 
197. In one implementation of CBC,-a cleartext block of a selected size is 
Exclusively ORed (XORed) or Exclusively NORed (XNORed):with a key 
block and with a preceding ciphertext block to. produce a new .ciphertext 
5 block. The resulting ciphertext block is XORed- or XNORed with a.next 
consecutive cleartext block and with the next consecutive key block, and so 
on until a final encrypted block is generated,. The operations XOR and 
XNOR'are each synimetricrcommutatiye, associative and bilinear so that 
order is not important within the ith step. If Pi, Ci and Ki (i = 1 , 2, ...) 
10 represent cleartext block number i, ciphertext block number i and key.block 
number i, respectively, a CBC procedure can be jepresented mathematically 
as • • ' V .•. ■ .... -; 

C(i+l) = PiXNORCiXNORKi, . ■ .. 

arid the initial ciphertext block (i=l) can be specified by one or more of the 
15-' Pi'Gs. The choice XNOR, rather than XOR; is made here because of a ^ 
useful "inversion" relation . " • ^ 

A XNOR A'= I (identity) , (2) 

for any block A of binary symbols. With this approach, preferably, the size 
of a key block Ki is the same as the size, of, a cleartext bloclc Pi and is the 
20 same as the^ size of a cipher text block Ci. -This consfraint can be relaxed . 
somewhat.-' • l: !" ."■..•.■ •: .:. 

When the encrypted rnessage.E(ISI)F) is received, the process is 
reversed;%egirining.with.an initial ciphertext block Ci' that.is.determined 

-using infotmation obtained #om_tiiat>d^ta:Si^^^ 

25 received as'part of the encrypted inessage-E(ISDF): . ., ^ . . .• 

•p(i+l) = C(i+l)'.XNORCi' XNQRPi. ' . ^ - - • (3) 
. Each of Eqs'. (1) and- (3) illustrates a .sub-encryptipn cycle (or sub- 
decryption cycle) :for the encryption or decryption process,. where ai) initial 
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ciphertext block is optionally provided by a key block. Ki with i = 1. Each 
sub-encryption cycle, set forth as an example in Eq. (1), \yill have an 
independently specified key component Ki. 

Figure 5 is d flow chart illustrating a file stripping algorithm that can 
be applied to an ISA using an embodiment . of the invention. In step 1 1 1, a 
first sequence of units (to hold an ISDF) and a second sequence of units (an 
SIF to hold the PPCs) are created; each; of unspecified length,, and the same 
FID is assigned to each sequence.. The assembled first and second , 
sequences will resemble the sequences shown in Figures IB and IC. In step 
1 13, a strip count index SG is set^equal to. the specified -number SB of PPCs. 
In step 115 - the first PPC, or the next PPC in the ordered sequence of PPCs, 
is moved firofn the initial sequence (Figure lA) to that PPC*s assigned place 
' in the second sequence. A selected portion of this PPC (which may be the 
empty set for a particular PPC) is stored, in a location, denoted as TK, for 
future use. The particular arrangement of bits or other information units 
stored in TK is referred to herein as the "content" of TK, written TK(c). A 
portion of this content TK(c) can also be used to determine one or more 
parameters for the encryption key EK. : _ : . 

In step 1 17, the strip couftt: index SC is decrernented by 1 (SG SG- 
"1 ): In step 1 19,^ the system examines the last unit in the particular : ■ ^ 
''^ component of the Second !5equenGe-- (PPCsXand;determines:i is 
afi end-bf-Me lihit (E0F:==^ 0)f If the answer to the query in .step 1 19 is "yes", 
the system sets aii'EOK flag equa:! to a selected value (e.g.? EOK = 1), in 
step 121, andthe procedure terminates,: at step •i;23c . 

If the answer to the query in step 119 is '"no", the system determines 
if the ^trip count index satisfies SC ~|Li:0;nn. step 127. If the answer to the 
query in step 127 is "no", the system recycles to step: 1 1 5 and the, procedure 
continues. If the answer to the query in step l'27:.is."yes"; the system 
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initializes the strip" count index to EB + TK(cl), in step 129, where TK(cl) 
is a selected subset of the content=TK(c) heldat the location TK. Use of a 
combination FB + TK(c 1 ), with TR(c 1 ) variable, allow,s ^e number of sub- 
cycles covered in the (following) steps 121 through 129 to be varied or 
5 "dithered" within the procedure..' - - . > . : ; 

' In step 131, the system:eiicrypts theiirst block, or the next . 
consecutive block, iii the 'first sequence ofmnits (ISDE). Instep 133, the 
system decrements theXnew). strip. coimt index SC .(SC. _ SC4). In step 135, 
the system determines if an EOF is present in this block. If the ans>^er to the 
10 quer>; in step 135 is'"yes'!, theiprocedure terminates at step 137. If the . • - _ 
answer to the query in step 135 is "no", ttie system determines if the (new) 
strip count index satisfies SC n 0, in step 139. If the answer to the query in 
ktep 139 is "no, the system recycles to step. 131 and the procedure contin^^s. 
If the answer to the query in step 139 is "yes", the system recycles to step 

15 113 and the procedure continues. ■ ■ . ■ ' ; ; 

Figure 6 is a flow chart illustrating a file assembly procedure that jan 

be used with an embodiment of the :invention. hi step ,141 , the system 
identifies the data supplement DS and^reads the parameters FB, KB, SISFD, 
• SPPC, EOK and.EK.In step 143, the system initializes an assembly count 
20 index,'AG = SB. Instep 145,, the system moves^the first block,,Qr the next ^ 
cbriseciitive block, of. the first sequencer.Qf,units .CPPQito jts proper location 
in the 6ri#nal:sequence of .units.(sprecifiedbySB; FBS^^^^ stores 
a selected portion of the;PPQinformation (which may bel^^ 
designated locationTRv In step.l47vtesy stem decrements the assembly 
25 count index (AC _ AC-1). ' : : - . : • - . - : 

; In step 1 49, the- system examines the last imit in the jjarticular 
cornpoiient of the second sequence ^PPC.s) and determines.(l).if this last 
unit is an end^of-file unit and (2);if:EOK. = 1 . If the answers to the 
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compound query in step 149 are "yes" and "yes", the procedure terminates, 
at step 15 1 . If the answer to one or both parts of the compound query in step 
149 is "no", the system sets the EOK flag equal to another selected value 
(e.g., EOK = 0), in step 155. In step 157, the system determines if the 
5 assembly courit index satisfies ACr|x 0.' - 

^ If the answer to the query in step 157 is "no", the system recycles to 
' st6p 145 and the procedure continues.. If the answer to the query in step 157 
' is "yes", the syistem resets an initial assembly, count index, AC = FB + 
TK(cl), in step 159, where TK(cl) is a selected subset of the. content TK(c). 
10 Again, use of a combination FB + TK(cl), with TK(q:1) variable, allows the 
number of sub-cycles covered in the (following) steps 161 through 1 69 to 
be varied or "dithered" within the procedure. 

"In step 161; the system decrypts the next consecutive block of a 
reassembled original sequence. In step 163, the system decrements the 
15 (new) asseriibiy-count index (AC AC- 1). In step 165, the system examines 
the last unit in the particular component of the first sequence (ISDF) and 
* determines (1) if this last unit is an end-of- file unit and (2) if EOK= 0. If the 
answers to this compound query, in step 165 are "yes" and "y^s", the system 
terminates the procedure, at step 167: If the answer to one or both parts of 
20 - the compound query in step 1 65 is""n6", the, system deternunes, at step 169, 
if the assembly count index AC .satisfies AC:^,OvJf thg -answer to tiie query 
at step 1 69 is "no^the system recycles to ste^p 16 1. and the procedure 
' ' continuesrif the answer to the query in.step 169 is -"yes", -thCc system 

recycles to step 143 .and the.pro'cedure continues. » r "• . r > 
25 In another embodiment, lio PPCs ate rernpved, and the, entire file 

* becomes an ISDF: No data supplement DS need be included, unless (part 
of) the encoding/encryption key EKjs to be communicated with the 
^ encoded/ericrypted^ version E(ISDF.) or as part of an SIF. Otherwise, the SIF 
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and the DS may be deleted in this embodiment. With reference to Figure 4, 
steps 87, 93, 99 and/or 103 are optionally deleted in this. embodiment. The 
file stripping algorithm, shown in- Figure 5, and the file assembly algorithm, 
shown in Figure 6, are not used in this embodiment; this may also be 
; implemented by formally setting FB-= SB =^ 0 in.Figures 5 and 6. . 
■ The disclosed procedure relies primarily upon several features to 
provide secure communicatiofi of an^ ISA, as two or more sequences, where 
no combination of less than all the sequences will produce an assembly of 
sounds that adequately resemble the original ISA. First, portions of the 
0 message, thePPCs, are removed from the original ISA and are , . ^ 
communicated separately, optionally using.a secure channel. Second^the 
remainder of the ISA, the ISDF; is encrypted, using an ;enccding or - . 
encryption key that can vary in length and other characteristics from one 
block or component of the ISDF to another, as indicated in the discussion.of 
15 Figures 5 and 6. third, information in biie or more of the PPCs can be used 
to determine one or more parameters in portions of the, encoding or . 
encryption key EK. Fourth, aii augmented PPC sequence PPC+DS can ^so 
be encoded and/or encrypted before communication thereof. 

Among other things,- an unauthorized (or unUcensed),recipient of the 
20 encoded/enciypted version E(ISDF) and/or of the:augmented PPC sequeiice 
■ ppc+DS would iided tabe-kware ofKl!) the.encoding or encryption key 
used to process the eftcodedyencrypted^version E(ISDF) (and, optionally, 
used to-eherypt th'e.augmented:PPe..sequence PPC+DS); (2),the placement 
and meaning of ISDF-'PPC<and/or EK information contained in the data 
25 supplement DS, t3) the use of theiinfoitoation in the data, supplem^^^ 

reposition =the PPGs Within -a decoded-.or decrypted ISDF, and ^4) possible 
variation of the encoding/encryption- keyfrom one LSDF component to the 
next, in bi-der to fiilly decode or.decf^pt an intercepted ISDF representing 
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and ISA. The number of parameters and block-to-block variability 
incorporated in this system allows one to distribute or otherwise provide 
one or more, but less than all, of the sequences formed from the ISA, 
without making available any version that can be intelligibly played back. 
5 The missing seqUehce(s) from tile ISA can be distributed to licensed or 
otherwise authorized "listeners", by another channel and/or at another time. 



10 



PCT/USOO/04012 

WO 00/49597 ' ' " 

1.7 

What is claimed is: 



i. A method of encoding or encrypting data, characterized by: 
providing an assembly of information-bearing sounds (ISA); . , 
removing one or more. selected segments of the assembly, to produce : 
i specified data file; . • .'" . . .. 

providing an encoding/encryption key and encoding or encrypting the 

specified data file; and 

communicating the encoded or encrypted specified data file in a first 
selected communication channel and communicating the removed segments 
in a second selected communication channel. 



2. The method of claim 1 , fiirther characterized by providing a data 
supplement that indicates at least one of: location of at least one of said 
15 removed segments within said ISA; size of at least one of said removed 
segments within said ISA; number of segments removed; separation 
distance between two consecutive removed segments within said ISA; and a 
selected portion of said encoding/encryption key; and 

communicating said data supplement in said second selected 
20 commimication channel. 

3. The method of claim 1, fiirther characterized by providing said 
encoding/encryption key with at least one key parameter that uses 
information fi-om at least one of said removed segments. 



25 



4. The method of claim 1, fiirther characterized by selecting said first 
and second communication channels to be the same channel. 



wo 00/49597 ' PCT/USOO/04012 

18 

5. The method of claim 1, further characterized by prDviding said 
second channel as a. secure communication channel. . 

6. The method of claim 1 , further characterized by concatenating said 
removed segments and said data supplement as- a concatenated data file. 

■ ' 7; The method of claim 5/ further characteriz encrypting said 
specified data file using cipher block chaining of at least one block of said 
concatenated data file and at least one encrypted block from said specified 
data file. ^ - / : ^ ; : . - . 

8. The method of claim. 7, further characterized by providing said at 
least one encoding/encryption parameter for. said encoding/encryption key 
by providing a block of said concatenated data file as an initial block for 
said at least one encrypted block of said data. 

9. The 'method of claim 1 , further characterized by removing at least 
first and second segmettts fi-om said data file,- where the first segmejit.and 
the second segment have equal, length. . 

• lb. The^niethbd of claim d^fi^ l^^st 
first and second segments froin said data file ■ where .the first segment and 
the second segment have different lengths. 

11. The metfiod of claim 1;: further characterized by combining said 
removed segments with said specified data file to form a combined data file 
and reproducing the combined data file as an assembly of sounds. 
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12. A method of decoding or decrypting data, characterized by: 
providing an encoded or encrypted first data file; . . . 
providing a second data file and a data supplement that indicates at 
least one of: an assigned location of at least one designated segment of the _ 
second data file within a non-coded and non-encrypted version of the first 
data file; size of at least one designated segment of the second data file 
within the nbn^coded arid non-ericrypted first data file; nmnb.er of selected 
segments designated; separation distance of at least two consecutive ^. . 
designated segmeiits of the second data file within the non-coded, and non- 
) encrypted first data file; and a selected portion of an encoding/encryption 
key used to encode or encrypt the first data file; and 

using the data supplement:to decode or decrypt the encoded or -.-^ 
encrypted first data file and t6 position ;at least a first sequence and a second 
sequence, drawn- fi-om the second data file, within the first data file. , ; 

13. The method of claim 12, fiirther characterized by providing said 
encoded or encrypted first data file= on a first eommunication channel and. 
providing said concatenation of said second data fil.e and said 4ata 
supplement on a second communiGatioii channel.. : . ; . . 

20 

14r:The method 

first arid Seednd ctohimunication channels to.b^^ ' " 
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1 5 . The method of claim 1 3 , fiirther characterized by providing said 
secondcKanriaas a'secm-e coiimmnication channel . 
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^ 16. The method of claim 19; ftirther characterized by determining at 
least one parameter of said encoding/encryption key using information in 
said second data file: : - 

17. The method of claim 12v.fiirther eharacte;rized by providing said 
encoded or encrypted first data filje , using, cipher block chaining of at least 
one block of said concatenation of said second data file and said data 
supplement and at least one encoded pr encrypted block from said first data 
file., ' , ^ - ; ^ . _ 

1 8 . The method of claim 1 7, further icharaeterized by providing at 
least one encodiQg/encryption key parameter for said encoding/encryption 
key by providing at least one of said first sequence and said second 
sequence as an initial block for said at least one encoded/encrypted block of 
said data. 

1 9. The method of claim 12, further characterized by providing said 
second data file and said data supplement as a concatenated data file. 

20. The method of claim 12, further characterized by combining said 
removed segments with said specified data file to form a combined data file 
and reproducing the combined data file as an assembly of sounds. 

2 1 . A method of communicating data, characterized by: 
providing an assembly of information-bearing sounds as a digital file 

of data; 

removing one or more selected segments from the data file, to 
produce a specified data file having at least a first block and a second block; 
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providing an encodihg/encryption key having at least a first key 
portion and a second key portion; 

providing a data supplement that indicates at least one of: location of 
at least one of the removed segments within the data file; size of at least one 
5 of the removed segments withihvthe data.file;.number of segments removed; . 
separation dist^ee between two consecutive. removed segments within the 
data file; and at least a portion- of the^encoding/e^^ 

' encbding of enciyptirig the first block and the second, block. of the 
specified data file, using the first portion and the second portion, 
10 respectively, of the encoding/encryption key; and 

. coiiununicating the encoded or encrypted- specified data file in a first 
selected communication Channel and corhmumcating the removed segm^ts 
and the data supplement in a second selected communication channel. ^. 
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